AD  A  08  9  7 


THl  BIAS  IN  THE  PRESENTATION  OF  STIMULI 
WHEN  THE  UP  AND  DOWN  METHOD  IS  USED 
WITH  FORCED  CHOICE  RESPONDING 

I 

David  J .  Blower 


July  1980 


1  % 

/ 

.  N  A ;  A  ;  'A  E  R  0  S  P  A  C  E  -ME  0  1C  At. 

RVE  SEARCH  LABOR  A  T  - : 

^  ’PENSACOLA J 

f  l  ORI  D  A  .  ,  -  . 

• 

-\  1 

• 

Approved  for  public  release;  distribution  unlimited . 


80  0 


Mt*'  . 


yp[m* %zJEtZJ 


) 


Approved  for  public  release;  distribution  unlimited. 


Naval  Medical  Research  and  Development  Command 


ZF51. 524. 004-2011 
Naval  Air  Systems  Command 


W  43-13.8881 


Approved  by: 


Released  by: 


Ashton  Graybiel,  M.D.  Commander  W.  M.  Houk,  MC,  USN 

Assistant  for  Sclentified  Programs  Commanding  Officer 


July  1980 

Naval  Aerospace  Medical  Research  Laboratory 
Naval  Air  Station 
Pensacola,  Florida  32508 


i 


i 


I 


SUMMARY  PAGE  j 

THE  PROBLEM 

3 

The  up  end  down  method  is  used  in  many  psychophysical  experiments 
to  determine  the  threshold  stimulus .  This  method  attempts  to  obtain  an 
accurate  estimate  of  the  threshold  by  concentrating  stimulus  presentations 
around  the  threshold .  However ,  if  the  up  and  down  method  is  used  in  conjunc¬ 
tion  with  forced  choice  responding ,  the  distribution  of  stimuli  presented  to  a  j 

subject  will  be  biased .  This  results  in  the  disproportionate  presentation  of  j 

stimuli  below  the  threshold  and,  as  a  consequence,  a  bias  in  the  estimate  of  j 

the  threshold  calculated  from  these  presentations .  This  paper  sets  out  to  \ 

answer  the  following  questions.  What  is  the  nature  cl  this  bias  in  stimulus  j 

.  presentation  when  the  up  and  down  method  s  used  with  four  alternative  forced  j 

choice  responding?  Can  this  bias  be  corrected  by  modifying  the  up  and  down  j 

method?  I 


FINDINGS 

The  exact  nature  of  the  bias  Induced  by  forced  choice  responding  in  the 
up  and  down  method  can  be  clearly  demonstrated .  An  example  is  given  for  a 
visual  acuity  threshold  problem .  The  up  and  down  method  can  be  analyzed 
theoretically  as  a  Markov  chain ,  and  the  probability  of  a  particular  stimulus  being 
presented  c  in  be  computed  for  every  trial .  The  up  and  down  method  can  be 
modified  to  force  convergence  of  stimulus  presentations  around  the  threshold 
value ,  even  in  the  forced  choice  case . 
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INTRODUCTION 


Dixon  and  Mood  (4)  proposed  the  up  and  down  method  as  a  technique  to 
concentrate  teeting  near  the  mean  of  a  normal  distribution .  This  technique 
was  soon  seen  to  be  an  economical  way  of  measuring  the  psychophysical 
threshold .  Cornsweet  (3)  and  Kappauf  (5)  illustrated  the  use  of  the  up  and 
down  method,  and  also  referred  to  other  work  where  this  technique  has  been 
used  to  measure  sensory  thresholds .  In  the  psychological  literature  the  up  and 
down  method  is  sometimes  called  the  staircase  method . 

If  the  up  and  down  method  is  used  in  conjunction  with  forced  choice 
responding,  then  the  presentation  of  the  stimuli  will  tend,  after  some  number 
of  trials,  to  concentrate  not  around  the  threshold  stimulus,  but  rather  at  levels 
below  the  threshold .  This  is  true  because  the  probability  of  a  correct  response 
never  goes  below  1/m,  where  m  is  the  number  of  response  alternatives.  This 
results  in  relatively  more  stimulus  presentations  below  the  threshold .  Also, 
most  estimators  of  the  threshold  based  on  the  accumulated  data  after  some 
number  of  trials  will  also  be  biased  for  the  same  reason .  The  object  of  this 
paper  is  to  give  a  precise  statement  about  the  effect  of  this  bias ,  and  to  offer 
a  modification  of  the  standard  up  and  down  method  which  will  correct  the  bias 
when  using  a  forced  choice  method  of  responding . 

The  approach  taken  to  examine  this  bias  is  as  follows .  We  assume  that 
there  is  a  fixed  number  of  stimuli  which  will  be  presented  to  a  subject .  We 
compute  the  probabilities  of  each  of  these  stimuli  appearing  on  the  next  trial  of 
the  up  and  down  process .  We  then  compute  the  expected  value  of  this 
probability  distribution  and  plot  it  as  a  function  of  the  trial  number.  In  this 
way  we  show  the  effect  of  forced  choice  responding  in  driving  the  mean  of  the 
probability  distribution  to  values  below  the  threshold . 

The  computation  of  the  probability  distribution  1b  made  possible  by 
formulating  the  up  end  down  method  as  a  Markov  chain  (6 ,  8) .  By  specifying 
the  probability  transition  matrix  and  the  initial  probability  distribution  of  the 
stimuli  at  the  start  of  the  experiment,  and  by  employing  a  simple  recursive 
formula  from  Markov  chain  theory ,  the  calculation  of  the  probability  distri¬ 
bution  of  the  stimuli  on  each  succeeding  trial  follows  quite  readily. 

DETERMINING  A  VISUAL  ACUITY  THRESHOLD  WITH  A 
FORCED  CHOICE  UP  AND  DOWN  METHOD 

As  an  example  of  how  bias  can  enter  into  the  presentation  of  stimuli  using 
the  up  and  down  method  with  forced  choice  responding,  consider  the  following 
problem . 

Let  us  assume  that  we  want  to  determine  a  visual  acuity  threshold  and 
that  we  are  using  Landolt  C  rings  of  known  gap  sizes  to  measure  the  threshold . 
Our  definition  of  the  threshold  is  the  size  of  the  gap  in  the  Landolt  ring  where 


the  probability  of  detecting  the  gap  ia  .50.  We  present  a  Landolt  ring  with  the 
gap  in  one  of  four  orientations  (up,  right,  down,  and  left)  uid  require  a 
response  from  the  subject  indicating  his  choice  of  which  of  the  four  orientations 
he  detected.  We  are,  therefore,  employing  a  four  alternative  forced  choice 
method  of  responding . 

If  the  subject  makes  a  correct  response ,  a  smaller  gap  size  is  presented 
on  the  next  trial.  If  the  subject  makes  a  wrong  response,  a  larger  gap  size  ia 
presented  on  the  next  trial .  The  step  size  is  the  difrerence  in  gap  size  between 
adjacent  stimuli. 

From  the  sequence  of  responses  emitted  by  the  subject  over  some  number 
of  trials  and  the  associated  stimulus  values  presented  we  would  like  to  estimate 
die  threshold  gap  size . 

Let  us  say  that  we  have  chosen  some  gap  sizes  from  a  psychometric 
function  relating  differing  gap  sizes  to  probability  of  detection .  Let's  say  we 
have  chosen  nine  different  gap  sizes  from  this  psychometric  function  such  that 
the  probability  of  detection  of  the  first  stimulus  is  .  90 ,  the  probability  of 
detection  of  the  second  stimulus  is  .80,  and  so  on.  Let's  pick  a  tenth  stimulus 
whose  gap  size  is  so  small  that  the  visual  system  cannot  possibly  resolve  it. 

Its  probability  of  detection ,  therefore ,  is  zero . 

Now,  the  probability  of  detecting  a  particular  gap  size  is  different  from 
the  probability  of  a  correct  response  to  that  gap  size  because  of  the  forced 
choice  nature  of  the  task .  We  can  easily  derive  a  formula  to  determine  the 
probability  of  a  correct  response  to  each  gap  size .  Consider  the  tree  diagram 
in  Figure  1 .  S  (j)  indicates  the  j^1  stimulus,  p  (DIS  (j) )  indicates  the_probability 
of  detecting  the  gap  given  that  particular  size  stimulus ,  and  D  and  D  represent 
detect  and  non-detact  states,  respectively.  With  probability  p (DIS (J)  the 
subject  enters  a  detect  state  and  emits  a  correct  response  with  probability 
one .  With  probability  1-p  (DIS  (j) ) )  the  subject  enters  the  non-detect  state,  but 
has  a  one-fourth  chance  of  emitting  a  correct  response .  He  has  a  three-fourths 
chance  of  emitting  the  wrong  response .  To  find  the  probability  of  a  correct 
response  we  sum  over  all  branches  leading  to  a  correct  response .  This  brings 

U8  to 

p (correct  response |S  (J))  =p  (DlS(j))  +1/4(1  -p(D|S(j)) 

Similarly, 

p  (wrong  response  |  S  (j) )  =  3/4  (1-p  (DiS  (j) ) 

Of  course ,  this  little  exercise  is  nothing  more  than  the  usual  correction 
for  chance  when  a  forced  choice  method  of  responding  is  employed . 
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CORRECT  RESPONSE 


Figure  1 .  Tree  diagram  showing  the  probabilities  of  a  correct  response 
and  wrong  response  In  a  four  alternative  forced  choice  situa¬ 
tion. 
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Table  I  presents  the  ten  stimuli  used  in  our  example  with  their  probability 
of  detection,  probability  of  correct  response,  and  probability  of  wrong  response. 

FORMULATING  THE  UP  AND  DOWN  METHOD  IN  TERMS 
OF  A  MARKOV  CHAIN 

The  up  and  down  method  can  be  thought  of  as  a  Markov  chain .  In  Markov 
chain  terminology  we  talk  about  the  probability  of  transitioning  from  state  i  on 
trial  n  to  state  j  on  trial  n+1 .  We'll  denote  this  probability ,  p  (i ,  j) .  The 
probability  01  being  in  a  certain  state  on  trial  n+1  depends  only  on  what  state 
the  chain  was  in  on  trial  n ,  and  is  independent  of  all  previous  trials . 

The  stimulus  presented  in  the  up  and  down  method  on  trial  n+1  depends 
only  on  the  response  to  the  stimulus  on  trial  n,  and  is  independent  of  the 
responses  on  'he  n-lst  trial,  n-2nd  trial ,  and  so  on .  The  probability , 
p  (i,  j) ,  of  going  from  stimulus  1,  S  (1) ,  on  trial  n  to  the  next  smaller  stimulus , 

S  (J) ,  on  trial  n+1  is  the  probability  of  a  correct  response  to  S  (i) .  The 
probability,  l-p(i,  J) ,  of  going  from  S(i)  to  the  next  larger  stimulus ,  S(k) ,  is 
the  probability  of  a  wrong  response  to  S  (i) . 

Tauie  n  gives  the  probability  transition  matrix  for  the  visual  acuity 
threshold  example .  We  observe  from  the  matrix  tuat  we  can  move  to  the  next 
smaller  gap  size  by  making  a  correct  response ,  and  that  we  can  move  to  the 
next  larger  gap  size  by  making  a  wrong  response .  The  only  exception  to 
this  rule  is  at  the  beginning  and  end  of  the  stimulus  series.  If  an  incorrect 
response  f'  ould  be  made  to  the  largest  gap  size,  S(l) ,  then  S(l)  is  presented 
on  the  next  trial .  If  a  correct  response  happens  to  be  made  to  the  smallest  gap 
size,  S  (10) ,  then  S  (10)  is  presented  again  on  the  next  trial. 

Let  tt(0)  be  a  row  vector  whose  elements  are  the  probabilities  of  present¬ 
ing  one  of  the  Lan  lolt  C  stimuli  on  the  initial  trial.  Markov  chain  theory  provides 
us  with  a  recursive  formula  which  allows  ub  to  calculate  the  row  vector  of 
probabilities  on  the  n^1  trial .  The  formula  is  simply 

ir  (n  +  1)  =  ir(ii)p 

where  p  is  the  probability  transition  matrix  (1) . 

SOME  RESULTS  CONCERNING  THE  BIAS  OF  STIMULUS 
PRESENTATIONS  IN  THE  ILLUSTRATIVE  EXAMPLE 

Three  different  row  vectors  were  used  to  start  the  up  and  down  process . 
The  first  row  vector  started  the  process  with  S  (1) ,  the  largest  stimulus ,  the 
second  row  v  ctor  with  S(5) ,  the  threshold  stimulus,  and  the  third  low  vector 
started  the  process  with  S(10) ,  the  undetectable  stimulus.  Figure  2  shows  the 
expected  value  of  the  probability  distribution  of  stimulus  values  to  be  presented 
for  these  three  situations  as  a  function  of  trial  number.  We  can  see  from  these 
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The  ton  stimuli  used  in  the  visual  acuity  example  with  their  associated  probabilities  of  detectic 
correct  response,  and  wrong  response.  S Cl)  is  the  largest  stimulus  and  S (10)  is  the  smallest. 


SC10)  0  .250  .750 


The  probability  transition  matrix  for  the  visual  acuity  threshold  problem .  This  transition  matrix 
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Figure  2 .  The  expected  value  o-  the  probability  distribution  of  the  stimuli  to 
be  presented  in  the  up  and  down  method  plotted  as  a  function  of 
trial  number .  These  curves  illustrate  how  the  up  and  down  method 
with  four  alternative  forced  choice  responding  converges  to  pre¬ 
sentation  of  stimuli  below  threshold . 


curve 8  the  bias  Induced  by  the  forced  choice  method  of  responding .  After  some 
number  of  trials,  all  three  curves  converge  to  a  value  of  about  6.6  rather  than 
the  threshold  value  of  5 .  The  mean  of  the  distribution  of  gap  sizes  to  be  pre¬ 
sented  in  the  up  and  down  method  has  been  shifted  to  the  smaller  gap  sizes . 

Another  way  of  viewing  the  bias  induced  by  the  fbzced  choice  method 
of  responding  is  to  add  up  the  probabilities  for  S  (7) ,  S  (8) ,  S  (9) ,  and  S  (10) ; 
i.e . ,  those  stimuli  for  which  the  probability  of  detection  is  .30  or  less.  Table 
m  presents  the  probability  distribution  of  all  ten  stimuli,  S  (1)  through  S  (10) , 
on  trials  49  and  50  in  the  case  where  the  process  was  started  with  S  (1) .  By 
trial  49,  the  subject  will  be  presented  with  a  stimulus  whose  probability  of 
detection  is  only  .30  or  less,  46  percent  of  the  time.  By  trial  50,  the  subject 
will  be  presented  wiii  a  stimulus  whose  probability  of  detection  is  .30  or  less, 

59  percent  of  the  time .  So ,  instead  of  concentrating  observations  around 
S (5) ,  the  threshold  stimulus,  forced  choice  responding  has  driven  the  up  and 
down  process  to  present  stimuli  well  below  the  50  percent  threshold  on  over 
half  the  trials . 

A  PROCEDURE  TO  CORRECT  FOR  THE  BIAS 

How  might  one  ameliorate  this  efioct  of  forced  choice  responding  on  the 
up  and  down  method?  One  method  which  substantially  reduces  the  bias  is 
presented  below . 

One  might  think  to  correct  this  bias  by  requiring  the  subject  to  emit  two 
correct  responses  before  presenting  him  with  the  next  smaller  stimulus . 

However ,  it  turns  out  that  this  procedure  overcompensates  for  the  bias  and 
results  in  too  many  presentations  above  the  threshold  stimulus. 

Since  requiring  one  correct  response  to  present  the  next  smaller  stimulus 
results  in  a  bias  below  the  threshold  and  requirir  g  two  correct  responses  to 
present  the  next  smaller  stimulus  results  in  a  bias  above  the  threshold ,  it  was 
natural  to  seek  some  mixture  of  these  two  rules  to  force  the  up  and  down  method 
to  concentrate  stilt  ulus  presentations  near  threshold .  The  procedure  proposed 
here  to  accomplish  tills  is  as  follows .  Generally ,  on  some  proportion  of  trials 
we  require  two  correct  responses  before  presenting  the  smaller  stimulus  on  the 
next  trial . 

Specifically ,  let  a  random  number  be  generated  on  trial  n .  If  this 
random  number  is  greater  than  some  fixed  value  and  tho  subject  responds 
correctly  to  S  (j) ,  present  S  (j)  on  trial  n+1 .  No  random  number  is  generated 
on  this  next  trial.  If  the  subject  responds  correctly  to  S  (j)  on  trial  n+1,  present 
S  (j+1)  on  trial  n+2 .  if  the  random  number  generated  on  trial  n  is  less  than 
the  fixed  value  and  the  subject  responds  correctly  to  S  (j) ,  present  S  (j+1)  on 
trial  n+1.  If  the  subject  responds  incorrectly  on  any  trial,  S  (j-l)  is  presented 
on  the  next  trial . 


Tills  verbal  description  is  sided  by  Figure  J  which  shows  the  procedure 
in  terse  of  s  partial  tree  diagram.  For  sslre  of  concreteness ,  the  stimuli  and 
probcbllittas  are  borrowed  from  the  visual  acuity  example .  Let's  say  S  (2)  was 
presented  on  trial  u.  Thu  probability  of  a  correct  response  to  S  (2)  is  .85 
and  ths  probability  of  an  incorrect  response  is  .15.  Let  p  be  the  probability 
that  the  random  number  generated  on  trial  n  exceeds  the  fixed  value.  There¬ 
fore.  £  represents  the  proportion  of  trials  on  which  we  demand  two  correct 
responses  to  get  to  the  next  smaller  gk^  site.  S'  (2)  is  the  notation  for  the 
fact  that  ths  subject  responded  correctly  to  S  (2)  on  the  previous  trial,  but  is 
presented  rdth  S  (2)  again  and  must  respond  correctly  on  this  second  presenta¬ 
tion  of  8  (2)  before  moving  to  S  (3) .  If  the  subject  responds  incorrectly  to  S  (2) 
on  trial  n  or  S'  (2)  on  trial  n+i ,  S  (1)  is  presented  on  the  next  trial . 

We  can  proceed  with  a  Marker  chain  formulation  just  as  before.  We  now 
have  to  add  the  primed  states  to  the  probability  transition  matrix  and  adjust 
the  probabilities  of  transltic  jdng  to  the  primed  and  unprimed  states  to  reflect 
the  value  of  p . 

The  probability  transition  matrix  for  one  value  of  p  (p  =  .5333)  is  given 
in  Table  IV.  This  value  was  selected  on  the  basis  of  experimentation  wit! 
different  values  of  p .  It  gave  the  beat  convergence  to  the  desired  mean  of  the 
probability  distribution  of  stimulus  values .  So.  in  effect,  in  just  slightly  over 
ha’f  the  trials  ve  require  ths  subject  tc  make  two  correct  responses  before 
presenting  him  with  the  next  smaller  gap  sire. 

SOME  RESULTS  USING  THE  NEW  PROCEDURE 

Just  as  in  the  previous  example,  we  present  in  Figure  4  three  curves 
showing  the  mean  of  the  probability  distribution  of  stimuli  to  be  presented  for 
each  of  three  starting  p^ntj  as  a  function  of  trial  number.  The  starting 
stimulus  values  were  again  S  (1) ,  S  (5) ,  and  S  (10) . 

We  see  that  this  new  up  and  down  method  does  converge  to  a  better 
concentration  of  stimuli  around  the  threshold  than  does  the  standard  up  and 
down  procedure . 

Table  V  gives  the  probability  distribution  for  S(l)  through  S(10)  on 
trials  49  and  50  for  the  modified  up  and  down  method .  S  (1)  was  used  as  ths 
starting  stimulus  in  this  case .  By  trial  50  of  the  modified  procedure  only 
about  19  percent  of  the  stimulus  presentations  have  probability  of  detection 
of  .  30  or  leas .  By  this  trial  in  the  standard  up  and  down  method  over  50  per¬ 
cent  of  the  presentations  were  stimuli  whose  probability  of  detection  was  .  30 
or  less . 

If  we  look  at  the  percentage  of  presentation  of  stimuli  around  the 
threshold,  (S  (4) ,  S(5),  and  5  (6)  whose  probabilities  o  f  detection  are  .60,  .50, 
and  .40,  respectively)  then  we  see  that  in  the  standard  up  and  down  method 
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The  first  half  of  the  probability  transition  matrix  for  the  visual  acuity  threshold  problem .  The 
modified  up  and  down  method  of  presenting  stimuli ,  as  explained  in  the  text ,  was  used  to  generate; 
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S  (9)  0  0  0  0  .6750  0  0  .1733  .1517 

S' (9)  0  0  0  0  .6750  0  0  0  .3250 

S(10)  0  0  0  0  0  0  .7250  0  .2500 


Figure  4.  The  expected  value  of  the  probability  distribution  of  the  stimuli 
to  be  presented  in  the  modified  up  and  down  method  plotted  as 
a  function  of  trial  number .  These  curves  illustrate  how  the 
modified  up  and  down  method  converges  to  the  threshold  even 


these  stimuli  are  presented  about  38  percent  of  the  time.  In  contrast,  these 
stimuli  appear  about  32  percent  of  the  time  in  the  modified  method . 

CONCLUDING  REMARKS 

I  have  attempted  in  this  paper  to  bring  to  light  the  bias  which  exists 
in  the  standard  application  of  the  up  and  down  method  when  used  with  forced 
choice  responding .  Sooner  or  later  in  the  process ,  stimulus  presentations  will 
be  skewed  to  the  low  end  of  the  detection  distribution .  Exactly  when  this  occurs 
lepecds  on  how  far  the  starting  stimulus  value  is  from  the  true  threshold  and 
01  the  magnitude  of  the  step  size  (2) . 

An  additional  finding  is  that  deriving  the  exact  probability  distributions 
of  the  stimuli  to  be  presented  on  the  nth  trial  is  made  relatively  easy  by  treat¬ 
ing  the  up  and  down  method  as  a  Markov  chain .  Modification  of  the  standard 
up  and  down  procedure  can  also  be  treated  in  terms  of  a  Markov  chain  and  its 
associated  probability  transition  matrix . 

One  easily  Implementable  strategy  has  been  proposed  to  negate  the  effects 
of  this  bias .  There  exist  other  methods  of  measuring  the  psychophysical 
threshold  which  are  resistant  to  bias  induced  by  forced  choice  responding  (7) . 

We  have  seen,  in  the  example  employed,  that  the  modified  up  and  down 
method  does  converge  to  the  threshold  value.  However,  if  the  process  has  been 
started  some  distance  away  from  the  threshold  value  (or  the  step  size  used  is 
very  small) .  it  will  take  a  considerable  number  of  trials  for  it  to  reach  the  region 
where  it  is  reasonably  close  to  the  threshold. 

This  finding  has  some  bearing  on  the  choice  of  an  estimator  of  the 
threshold  value .  If  we  had  no  prior  information  about  where  we  were  starting 
the  process  with  regard  to  the  threshold ,  we  might  want  to  adopt  a  conservative 
strategy  and  ignore  in  our  computation  of  the  threshold  some  number  of  the 
initial  trials.  We  could  then,  for  example,  average  the  stimuli  presented  after 
this  trial  number .  We  would  be  excluding  from  our  estimation  of  the  threshold 
those  values  which  are  far  from  the  threshold .  We  would ,  in  addition ,  reduce 
the  variability  of  our  estimator . 


REFERENCES 


1.  Atkinson,  R.  C.,  Bower,  G.  H.,  and  Crothers,  B.  J.,  An  Introduction  to 

Mathematical  Learning  Theory.  New  York:  John  Wiley  and  Sons ,  Inc . , 
1965 

2.  Brownlee,  K.  A. ,  Hodges,  J  L. ,  and  Rosenblatt,  M. ,  The  up-and-down 

method  with  small  samples.  J.  Am.  Stat.  Assoc. .  48:262-277,  1853. 

3 .  Cornsweet ,  T.  N. ,  The  staircase  method  in  psychophysics .  Am.  J . 

Psychol.,  75:485-491,  1962. 

4.  Dixon,  W.  J. ,  and  Mood,  A.  M. ,  A  method  for  obtaining  and  analyzing  sensi¬ 

tivity  data.  J.  Am.  Stat.  Assoc . ,  43: 109-1256,  1948. 

5.  Kappauf,  W.  E. ,  An  empirical  sampling  study  of  the  Dixon  and  Mood  statis¬ 

tics  for  the  up-and-down  method  of  sensitivity  testing .  Am .  J .  Psychol . , 
82:40-55.  1969. 

6.  Smith,  J.  E.  K. ,  Stimulus  programming  in  psychophysics.  Psychometrika, 

26:  27-33,  1981. 

7.  Taylor,  M.  M. ,  and  Creelman,  C.  D. ,  PEST:  Efficient  estimates  on  proba¬ 

bility  functions .  J.  Aooust.  Soc.  Am. ,  «: 782-787,  1987. 

8.  Wetherfll,  G.  B.,  Chen.  H.,  and  Vasudeva,  R.  B.,  Sequential  estimation 

of  quintal  response  curves:  A  new  method  of  estimation .  Blometrika , 
53:439-454,1966. 


17 


,  I 


UNCLASSIFIBD 


REPORT  DOCUMENTATION  PACE 

READ  INSTRUCTIONS 

BEFORE  COMPLETING  FORM  • 

1.  REPORT  NUMBER  *.  OOVT  acccuIon  NO. 

NAMRL  -  1269  flb~  9 

S.  RECIPIENT'S  CATALOG  NUMBER 

90 

4.  TITLE  (And  Submit) 

The  bits  In  the  prteentatlon  of  stimuli  whan  the  up- 
snd-  down  method  is  ussd  with  forced  choice 
responding . 

S.  TYPE  OP  REPORT  A  PERIOD  COVERED 

INTERIM 

A.  PERFORMING  orq.  REPORT  number 

2.  AUTHOR(a> 

David  J .  Blower.  LT.  M8C,  USNR 

1.  Contract  or  orant  nuueert«> 

».  performing  organization  name  ano  AOONCSS 

Naval  Aerospace  Medical  Research  Laboratory 

Naval  Air  Station 

Pensacola,  Florida  32503 

10.  PROORAM  ELEMENT.  PROJECT,  TASK 

area  a  work  unit  numbers 

NMRDC  ZF51. 524. 004. 2011 
NAVAIR8YS COM  W43-13.8881 

11.  CONTROLLING  OFFICE  NAME  ANO  ADDRESS 

Naval  Medical  Research  5  Development  Command 
National  Naval  Medical  Center 

Betheada,  Maryland' 20014 

12.  REPORT  DATE 

July  1080 

IS.  number  op  paqes 

21 

T*.  MONiTORlNO  AGENCY  NAME  A  ADORESV"  dlllmtm if  Itom  Controlling  Ollloo) 

IS.  SECURITY  CLASS,  (ol  Nila  report) 

UNCLASSIFIED 

ISa.  DECLASSI  PI  CATION/ DOWN  OR  ADI  NO 
SCHEDULE 

t*.  DISTRIBUTION  STATEMENT  (o  1  (fill  Report) 

Approved  fcr  public  release;  diatrlbutien  unlimited. 

IT.  DISTRIBUTION  STATEMENT  (ol  llto  obttrocl  entered  In  Block  30,  II  dlttoronl  from  Roporl) 

is.  supplementary  note* 

1*.  KEY  WO  N  01  f  Con  f/nue  on  feveree  eld#  It  neceeenry  md  Idontlty  by  block  n  umber  J 

Up-and-down  method 

Stimulus  presentations 

Forced  choice 

Bias  in  stimulus  presentation 

Visual  acuity  threshold 

20.  AISTRACT  fCoftllnua  on  rarer  a  a  s/de  It  neceeenry  md  Identity  by  block  number) 

-  -  ■*  The  up-and  -down  method  is  used  in  many  psychophysical  experiments  to  deter¬ 
mine  the  threshold  stimulus.  This  method  attempts  to  obtain  an  accurate  estimate  of 
the  threshold  by  concentrating  stimulus  presentations  around  the  threshold .  Row- 
|  ever,  if  the  up-and-down  method  is  used  in  conjunction  with  forced  responding, 

'  the  distribution  of  stimuli  presented  to  a  subject  will  be  biased .  This  results  in  the 
disproportionate  presentation  of  stimuli  below  the  threshold  and.  as  a  consequence 

| 


DD  , 


f  OKM 
JAN  71 


1473  COITION  OF  I  K3V  ••  If  OBSOLETE 

S/N  0102-  LF-Ol  1-6401 


UNCLASSIFIED 


SECURITY  CLASSIFICATION  or  THIS  PA«E  fBtian  Om»m  *»*' 


.  .J 


UNCLASSIFIED _ 

tgCUWTV  CLASSIFICATIQh  OF  THIS  RAPE  fWnw  Dttm  Enl— < 

a  bits  in  the  estimate  ef  the  threshold  calculated  from  these  presentations .  This 
paper  sets  out  to  answer  the  following  questions.  What  is  the  nature  of  this  bias 
in  stimulus  presentation  when  the  ttp-and-down  method  is  used  with  four  alter¬ 
native  forced  choice  responding?  Can  this  bias  be  corrected  by  modifying  the 
up-and-down  method? 

The  exact  nature  of  *he  bias  induced  by  forced  choice  responding  in  the  up- 
and-down  method  can  be  clearly  demonstrated .  An  example  ia  given  for  a  visual 
acuity  threshold  problem .  The  up-and-down  method  can  be  analyzed  theoreti¬ 
cally  as  a  Markov  chain  and  tha  probability  of  a  particular  stimulus  being  pre¬ 
sented  can  be  computed  for  every  trial .  T'io  up-  and-down  method  can  be  modi¬ 
fied  to  force  convergence  of  stimulus  presentations  around  the  threshold  value, 
even  in  the  forced  choice  case . 


S/N  0102-  LF-  014-  6401 


UNCLASSIFIED 

SECURITY  CLASSIFICATION  OF  THIt  RAOEOSNan  Dmtm  Bntmd) 


